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Abstract 

Given a finite set N of feasible points of a multi-objective optimization (MOO) prob¬ 
lem, the search region corresponds to the part of the objective space containing all the 
points that are not dominated by any point of N, i.e. the part of the objective space 
which may contain further nondominated points. In this paper, we consider a represen¬ 
tation of the search region by a set of tight local upper bounds (in the minimization case) 
that can be derived from the points of N. Local upper bounds play an important role 
in methods for generating or approximating the nondominated set of an MOO problem, 
yet few works in the field of MOO address their efficient incremental determination. We 
relate this issue to the state of the art in computational geometry and provide several 
equivalent definitions of local upper bounds that are meaningful in MOO. We discuss the 
complexity of this representation in arbitrary dimension, which yields an improved upper 
bound on the number of solver calls in epsilon-constraint-like methods to generate the 
nondominated set of a discrete MOO problem. We analyze and enhance a first incre¬ 
mental approach which operates by eliminating redundancies among local upper bounds. 
We also study some properties of local upper bounds, especially concerning the issue of 
redundant local upper bounds, that give rise to a new incremental approach which avoids 
such redundancies. Finally, the complexities of the incremental approaches are compared 
from the theoretical and empirical points of view. 

Keyvifords: Multiple objective programming, Search region, Local upper 
bounds. Generic solution approaches 


1 Introduction 

Most solution approaches in multi-objective optimization (MOO) aimed at outputting a set 
of “good” solutions iteratively generate candidate solutions. Generally, a pool of solutions is 
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maintained and updated when new solutions arrive. The pool provides information which is 
used to decide whether a new solution should be inserted and whether old solutions should 
be removed. It can also be used to guide the search process within the objective space. In 
particular, from the images in the objective space of the pool solutions, we can define the 
part of the objective space containing all points that none of these images dominate, which 
we refer to as the search region. 

The concept itself is well known in the field. Especially in the two dimensional or bi¬ 
objective case, it is a key tool of the two-phase and branch and bound methods. In the 
two-phase method (see Ulungu and Teghem, 1995), adjacent extreme nondominated points 
computed in the first phase dehne triangles which delimit zones where all other nondominated 
points he. The so-called local nadir points corresponding to the right angles of these triangles 
act as local upper bounds that together define the search region, assuming that the objectives 
are to be minimized. This upper bounding part is also one of the foundations of multi¬ 
objective branch and bound (see Sourd and Spanjaard, 2008). Actually, the representation 
of the search region through local upper bounds makes it possible to test the existence of 
the intersection between the search region and a convex lower bound on the feasible points 
associated to a search node and to decide whether to fathom the search node or not. 

Given a discrete set of points Q C Kaplan et al. (2008) consider maximal empty 
orthants with respect to Q, which contain no point of Q and are maximal for this property 
under inclusion. Assuming that the points of Q are feasible points of an MOO problem, 
the union of all maximal empty orthants corresponds to the search region associated to Q 


and their apexes correspond to local upper bounds in the context of MOO. Kaplan et al. 


(2008) give an algorithm for the generation of all maximal empty orthants, and hence for 
the computation of all local upper bounds of the search region. However it requires that the 
input points are given in a nondecreasing order of some component and in this sense does not 
directly imply an incremental approach. 


Przybylski et al. (2010) consider local upper bounds in arbitrary dimension for a general¬ 


ization of the two-phase method to problems with arbitrarily many objectives. They propose 
an online algorithm to carry out the update of the local upper bounds as soon as new feasible 
points are discovered, but they do not consider the complexity of this operation. 

Several solution methods to generate the nondominated set iteratively solve linear pro- 


grams parameterized by local upper bounds (see 

Sylva and Crema 

, 2007 

), possibly including 

redundancies (see 

Lokman and Koksalan 

2013;|Kirlik and Saym 2014). 

In 

Sylva and Crema 


(2007) each local upper bound is determined by solving an integer linear program. 

Also, Dachert and Klamroth (2015) propose to compute boxes for three dimensional MOO 
problems that are defined by a common lower bound and several upper bounds and decompose 
the search region. They develop an efficient incremental algorithm, that avoids redundancies, 
to update the decomposition each time a nondominated point is found, through e.g. the 
optimization of a pseudo-distance function parameterized by the dehning points of the box. 
In particular, they show that, in the three dimensional case, the search region can be described 
by 2n -|- 1 boxes if the number of known feasible points is n. 

The paper is organized as follows. Section sets some notations, formally defines the 
concepts of search region and upper bound set, then motivates their use in MOO. Section 
shows the existence and uniqueness of local upper bounds through a first algorithm for which 
we discuss some enhancements. Section investigates some properties of the elements of 
upper bound sets that yield another approach to compute an upper bound set. Section is 
devoted to the complexity aspects related to the representation of the search region by a set 
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of local upper bounds and the comparison of the two approaches from both theoretical and 
empirical points of view. Finally, Section provides conclusions and perspectives. 

2 Background and motivations 

2.1 Multi-objective optimization setting 

We consider MOO problems 


min f{x) = {fi{x),...,fp{x)) .. 

s.t. X G X ^ > 

with feasible set X 7^ 0 and with p >2 objective functions fj : X —)• R, j G {1,... ,p}. Let 
Y = /(X) denote the set of all feasible points in the objective space. For all j G {1,. •. ,p} 
and X G X, we assume, for any instance of an MOO problem, that m < fj{x) < M for some 
m,M G R, or that such values m and M exist that bound the area of interest for the decision 
maker. We will refer to Z = (m, M)p as the p-dimensional search interval, a set that contains 
all feasible or at least all relevant points. We denote by Z = [m, MY the closure of Z. 

The Pareto concept of optimality for MOO problems is based on the componentwise 
orderings of R^ defined for z^,z^ G R^ by 


zi 

<Z2 

(z^ weakly dominates z^) 


z^ < z^ 

V — ’ 

j e {!,• 

...,p} 

z' 

<Z2 

(z^ dominates z^) 


Z^ < Z2 

and z^ 

to 

zi 

<Z2 

(z^ strictly dominates z^) 


X ^ X ’ 

j = 1, 

...,p. 


A point G R^ is called dominated by z^ G R^ if z^ < z'^. If, moreover, z^ < then 2^ is 
called strictly dominated by z^. A subset X of Z is stable for the dominance relation < or 
simply stable if for any z^,z‘^ G X, ^ z'^. For any subset Q of R^, Q^d is the set of all 
nondominated points of Q, i.e. Qnd = {z ^ Q : there exists no z G Q with z < z}. We refer 
to Ynd as the nondominated set of and every point z G Wd is called nondominated. 

Note that M must therefore be strictly greater than the component values of the nadir 
point, defined as the componentwise maximum of the nondominated points, i.e. {ma,x{zj : 

z G Xnd})je{l,...,p}- 

We define some general notations. We denote by M the p-dimensional vector (M,..., M) 
and analogously the p-dimensional vector m = (m,..., m) and the p-dimensional all-ones 
vector 1. For any z G R^, we let Z-j be the {p — l)-dimensional vector of all components 
of z excluding component j, for a given j G {1,... ,p}. Finally, for any z, a G R^ and any 
j G {1,... ,p}, (zj, a-j) denotes the vector (oi,..., aj-i, Zj, aj+i ,..., Op). Such a vector will 
be referred to as the jth projection of vector z on vector a. 

2.2 The search region 

In the following definition, we formalize the concept of search region which we presented in 
the introduction. 

Definition 2.1. Let N be a finite and stable set of feasible points. The search region for 
Tnd \ X, denoted by S{N), contains all the points in Z that could be nondominated given N, 
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or alternatively, excludes all the points in Z that are dominated by at least one point in N, 
that is: 

S{N) = {z € Z : yz € N, z % z} . . 

= Z \ {z e Z : 3z e N with z ^ z} 

Note that the search region S(N) excludes the points in N, since they are already known, 
that is, S{N) n iV = 0. 

In some cases, is a subset of Ynd obtained by some scalarizing function. More gener¬ 
ally, N may contain any feasible point, no matter how it is obtained, e.g. by any heuristic 
procedure. It could even be any stable set of not necessarily feasible points from Z, provided 
none of its points dominate any point of the nondominated set Ynd. 

Regarding the stability condition on N, it can be easily seen that the set S{N) is not 
affected if a point dominated by another point of N is added. In other words; 

Remark 2.2. For any set of points Q, we have S{Q) = S{Qnd), i-^-, both sets induce the 
same search region. 

Consequently, the assumption that the set N is stable can be made without loss of generality. 


2.3 Explicit representation of the search region by local upper bounds 

Our purpose is to find an explicit and concise characterization of S{N) using a finite set 
U{N) of minimal local upper bounds, which could also be referred to as local nadir points or 
maximal points (for the dominance relation). We will refer to U{N) as an upper bound set 
for the search region S{N) in the following. 

Every local upper bound u £ U{N) defines a search zone C{u) d Z as 


C{u) = {z £ Z : z < u}, 


and the search region S{N) is covered by the union of these search zones. In order to possibly 
include any point of Z in a given search zone C{u), the possible values for u should include 
the boundary of Z. So in general U{N) is a subset of Z, the closure of the search interval Z. 

In the following, we give three alternative definitions for upper bound sets and show their 
equivalence. 

Definition 2.3. Let N <Z Z be a finite and stable set of points. A set U{N) d Z is called an 
upper bound set with respect to N if and only if 


(1) S{N) — Uuei7(Af) 

(2) yu\u^ £ U{N), C{u^) C{u^). 


While condition (1) in Definition 2.3 guarantees that the search region S{N) is exactly 
represented by the search zones induced by U{N), condition (2) ensures minimality of the 
set U{N) in the sense that no redundant search zones are contained in the representation. 
Observe that this definition can be seen as a natural extension of the concept of upper bound 
in the one-dimensional case. If p = 1, a stable set may either be empty (N = 0), or it may 
consist of exactly one point {N = {^}). The corresponding search region is then uniquely 
represented by one point, namely u = M in the first case and u = z va the latter case. 

As an example, we describe the situation in the two-dimensional case. 
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Example 1. Let N = {{z\, z\),, (z”, )} be a stable set of two-dimensional points (with 

n > 1). In the bi-objective case, the points in any stable set N can be ordered such that 
the objective values are strictly increasing in the first objective and strictly decreasing in the 
second objective. Hence we can assume that zl < ■ ■ ■ < Zi and z^ > ■ ■ ■ > z^. The search 
region consists of the union of search zones defined by pairs of consecutive points in N. Thus 
the upper bound set associated to N is 

U{N) = { {zl,M) , {zl 4) , {zl zl),..., {zl 4-4 , (M, 4)} 

We illustrate this example in Figure 


/2 
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X 



X Points in N 
Search region S{N) 

• All local upper bounds of U{N) 


X 
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X • 

- 1 —> 
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Figure 1: Illustration of the concepts of search region and local upper bound {p = 2) 


The conditions of Definition |2.3| can immediately be reformulated in terms of pairwise 
comparisons between points in S{N) and U{N). 

Proposition 2.4. Let N <Z Z be a finite and stable set of points. Then U{N) G Z is an 
upper bound set with respect to N if and only if 

(la’) \/z £ S{N) 3u £ U{N) : z < u, 


(lb’) Mz £Z\S{N)\/u £ U{N) -. z<fiu, and 
(2’) E U{N) : ^ . 


Proof. Conditions (la’) and (lb’) together are equivalent to condition (1) in Definition 2.3 


and condition (2’) is equivalent to condition (2) in Definition 2.3 


□ 


In the case where the search interval is restricted to integer-valued vectors, i.e. Z C 
conditions (la’) and (lb’) of Proposition 2.4 can be further specihed since for all z,z' £ IP 
such that z < z', we have z ^ z' — We briefly restate them in the following remark. 


Remark 2.5. Assume Z <ZlP and M £ ’IP. Under the same hypothesis of Proposition f2^ 
we have for the upper bound set U{N) C Z: 


(la”) \/z £ S{N) 3u £ U{N) : z — 1 and 
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(lb”) Vz E Z \ S{N) 'iu E U{N) : z$u-l 

This is particularly useful in the context of the two-phase and branch and bound algo¬ 
rithms which we discuss at the end of this section. 

A yet alternative characterization of local upper bounds that will turn out useful for their 
efficient determination is given in Proposition |2.6[ In particular, local upper bounds are 
exactly those points that (i) are not strictly dominated by any of the points in N, and (ii) 
are maximal with this property. 

Proposition 2.6. Let N <Z Z be a finite and stable set of points. Then U{N) G Z is an 
upper bound set with respect to N if and only ifU{N) consists of all points u £ Z that satisfy 
the following two conditions: 

(i) no point of N strictly dominates u and 

(ii) for any u £ Z such that u> u, there exists z £ N such that z < u, i.e., u is a maximal 
point with property (i). 

Proof Let U{N) denote the upper bound set with respect to N, and let U'{N) denote the 
set of all points satisfying (i) and (ii) above. 


Claim 1: U{N) C U'{N). Let u £ U{N). We show that u satisfies (i) and (ii). 


(i) Assume that there exists a point z £ N such that z < u. Then by condition (1) of 
z E C{u) C S{N), which contradicts S{N) H N = (}. 


Definition 2.3 


(ii) Let u > u and hence C{u) C C{u). Since u £ U{N), by condition (2) of Definition 2.3 


we get u 0 U{N). Thus, there exists a point z' £ C{u) such that z' £ Z \ S{N). Since 
z' £ Z \ S{N), there exists a point z £ N with z ^ z' and hence z < u. 


Claim 2: U'{N) = U{N), i.e., we show that U'{N) satisfies (1) and (2). First observe 
that for any u' £ U'{N), we have C{u') C S{N). Indeed, if there exists z' £ C{u') \ S{N), 
then there exists z £ N such that z z' . Since z' < u\ we get z < u' contradicting condition 

(i). 

(1) Let u' £ U'{N). Then we have C{u') C S{N) and hence [ju'eU'{N) ^ ^'(Ai). 

From Claim 1 above, we have 

S(N)= U U 

u&U{N) u'&U'{N) 

and thus \Ju'&U'{N) ^(^0 = ‘S'(A^)j which proves (1). 

(2) Now let E U'{N). Then we have C'(u^) C S{N) and C{u^) C S{N). If C{u^) C 

C(u^), then (ii) would be violated. This proves (2). 


□ 
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2.4 Related concepts 


In computational geometry, Kaplan et al. (2008) define maximal empty orthants with re¬ 


spect to a discrete set of points Q C as partially bounded hyperrectangles of the form 
nj=i(—oo,Oj) C for some a G R^ (apex), which contain no point of Q and are maxi¬ 
mal for this property under inclusion. It is clear that such points a satisfy the conditions of 


Proposition 2.6 and are therefore local upper bounds for the search region S{Q). 

For their generalization of the two-phase method to MOO problems with more than two 


objectives, Przybylski et al. (2010) are interested in characterizing the part of the objective 


space where remaining nondominated points have to be searched after phase one. To this end, 
they define a concept similar to our search region, the search area. The search area S'{N) is 
defined as the closure of the complement set of {z G R^ : Bz' G N,z' ^ z}, i.e., 

S'{N) = cl {{z G R^* : 3z' GN,z' ^ z}^) . 


N is defined in Przybylski et al.| (|2010[) a s an upper bound set for the nondominated set in 
the sense of Ehrgott and Gandibleux (2007), and can also be any stable set of feasible points. 


Note that we omit from their definition a lower bounding part, which is not relevant for our 
purpose. 

In fact, the search area S'{N) corresponds to the closure of the search region S{N) defined 
according to equation ([^ in Definition 2.3 This difference implies that the search area S'{N) 
includes N and even points of the objective space that are weakly dominated by some points 
of N. 


Przybylski et al. (2010) and Dachert and Klamroth (2015) also describe the search area 


by a set of earner points or upper hounds which are the same as the local upper bounds we 
consider in this paper. The former rely on a definition for these points which corresponds to 


Proposition 2.6 


2.5 Application for the solution of MOO problems 

The concepts and properties developed in Sections |2 . 2| and [2 . 3| apply to MOO in general. For 
continuous and mixed discrete-continuous problems, they are useful in approaches aimed at 
generating discrete representations of the nondominated set. In the case of discrete problems, 
such as multi-objective combinatorial optimization (MOCO) problems, they play an impor¬ 
tant role in the generation of the nondominated set as well. In this section, we focus on the 
latter issue and mention two widely applied methods to show how the computation of local 
upper bounds can be integrated into an overall solution strategy. 


A generic method based on the solution of budget constrained programs The 

representation of the search region as a set of search zones makes it possible to derive a 
simple algorithm to enumerate all nondominated points of a MOCO problem. This can be 
done by iteratively exploring the search zones that define the search region and updating the 
search region whenever new points are found. The exploration of a search zone C{u) has to 
determine whether C{u) contains feasible points, and if so output one such point. In order to 
limit the number of search zones that are considered, the exploration routine should return 
only nondominated points. Such an exploration can be achieved by solving, for example, the 
following mathematical program associated to a search zone C{u): 

P{u) : min{c?(/(x)) : x G XJ{x) < u} 
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where g is any strongly increasing aggregation function of the /j’s (e.g. g : z 

Note that the strict dominance in the definition of P{u) can be transformed into non-strict 

inequalities by slightly decreasing u since X is a discrete set, or, when possible, by taking 

Problem P{u) can be seen as a variant of the e-constraint method 
1983[) and was proposed in Chalmet et al. (1986) using a 


advantage of Remark 2.5 
(see e.g. 


Chankong and Haimes 


weighted sum function with positive weights as function g. 

The generic method is presented in Algorithm]^ From property (2) of Dehnition 2.3, there 
is no redundant constrained program among the programs associated to the search zones of 
the current search region. 


Algorithm 1: Generic method to generate all nondominated points of a MOCO problem 
based on the definition of search zones _ 

input : X, /, M 
output: 


1 

2 

3 

4 

5 

6 
7 


X ^ 0; U{N) ^ {M} 
while U(N) / 0 do 
Select u G U{N) 
if P{u) is feasible then 

Let ^ be an optimal point of P{u) 
N ^ NU{z} 

Update U{N) 


8 else 

9 L U{N) ^ U{N) \ {u} 


10 return N = Tnd 


Now we count the number of constrained programs that have to be solved in Algorithmic 
Note that each local upper bound that is considered at Step will either lead to a non¬ 
dominated point or be part of the final upper bound set (if the associated P{u) 

has no feasible solution). Therefore the number of calls to the exploration routine is ex¬ 
actly m(Yn ri)l + |Tnd|- This, together with the tight upper bound on |C/(Tnd)| provided in 


Section 


5.1 


amounts to 0(|l^d|^2^) solver calls for p>2. 


Many papers in the literature propose overall strategies, based on solving budget con- 


strained programs, that generate the nondominated set 

Ghalmet et al. (1986); iLaumanns 

et al. 

(2006); 

Sylva and Grema 

(2008 

); 

Ozlen and Azizoglu 

(2009 

); 

Lokman and Koksalan 

(2013 

; Kirlik and Saym 

(2014); 

Dachert and Klamroth 

(201f 

)). To our knowledge, only ap- 


proaches specialized to the bi- and tri-objective cases provide a non-trivial upper bound on 
the number of solver calls. Good upper bounds are known, however, for p = 2 and p = 3. 
Ghalmet et al. ( |1986 ) propose an approach for the case p = 2, similar to Algorithm [I| where 


exactly 2|ljid| + 1 solver calls are required. In the more complex case p = 3, Dachert and 


Klamroth (2015) suggest a closely related method and show that at most 3|Ljid| ~ 2 solver 


calls are needed in this case. 


MOBB aud two phase methods In multi-objective branch and bound (MOBB), a 
bounding step is performed at each node of a search tree. Assume we consider the current node 
whose set of feasible solutions is X' C X. In general, computing either X' or Y' = f{X') would 
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be expensive. However, given a set of, say m weight vectors A^,..., of such that for any 
i G {1,..., m}, A® > 0, we may approximate by computing Oj = min{^^^^ X^-Zj : z G H'}, 
especially if the single objective version of the underlying problem is solvable in polynomial 
time. Denoting by Q the set {z G Z : ^ = 1; • • • > we have Y' C Q, thus 

Y^^ C Q. Therefore, if Q n S{N) = 0 then the current node can be pruned since it cannot 
yield any new nondominated point. 

Consider also the two-phase method, and especially the version where a ranking algorithm 
is used to obtain, in phase two, nondominated non-extreme points. A set of weight vectors 
A^,..., A”® that satisfy the same conditions as above is obtained in phase one. At some time 
during phase two, we are given m values ai,..., am G R such that for each z G {1,..., m}, all 
feasible points whose weighted sum value according to the weight vector A® is less than or equal 
to ai have been computed. Considering N as the set of all these feasible points, excluding 
the dominated ones, we can test whether the set Q = {z G Z : J2j=i * = !> ■ ■ ■ > 

intersects the search region S{N). 

Now we explain how local upper bounds help to determine whether such a polytope Q 
intersects the search region. For any A G R^ such that A > 0 and for any z,z' G R^ such that 
z < z', we have Yl^j=i Therefore, together with conditions (la’) and (lb’) 

of Proposition |2.4[ we obtain: 


Q n S{N) = 0 if, for all u G U{N), there exists i G {1,..., m} 

p 

such that (Rule “R”) 

i=i 


If the feasible points are integral, that is we restrict ourselves to integer vectors in both 
S{N) and Q, the above condition for Q n S{N) = 0 can be strengthened using Remark 
In this case, we rely on the following implication: if z and z' are two vectors such that z z\ 
then Then in this case, we have: 


2.5 


Q n S{N) = 0 if, for all u G U{N), there exists i G {1,..., m} 


such that XjUj < a^ — ^ A® (Rule 
1=1 1=1 


These rules are used by Sourd and Spanjaard (2008) in the context of MOBB to find all 


nondominated points of the bi-objective minimum spanning tree problem. Przybylski et al. 


(2008) also use them in a two-phase method based on the use of a ranking algorithm to find 
all nondominated points of the bi-objective assignment problem. Przybylski et al. (2010| 


consider their application again in a two-phase method not limited to the bi-objective case. 
The rules they propose for the general multi-objective case are related to their definition of 
the search area we presented in Section |2.4[ which implies that the rule for the integral case 
is a little weaker than IRule 
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3 Existence and construction of upper bound sets 


The initial search region consists of the whole search interval Z. Therefore, it can be described 
by the following upper bound set: 

C/(0) = {M}. 


Actually, this defines the unique search zone C{M) = Z, which is consistent with Dehni- 
tion[T3l 

Starting with this in the case = 0, a simple incremental algorithm can be formulated 
that iteratively introduces points to the set N and updates the upper bound set U{N) ac¬ 
cordingly. It was first proposed by Przybylski et al. (2010) with a slight difference in the 


hltering step to which we shall return later. Given a hnite and stable set N G Z, a corre¬ 
sponding upper bound set U{N), and a point z & Z that is nondominated with respect to N, 
Algorithmdescribes the updating procedure to obtain the upper bound set U{NU {z}). 


Algorithm 2: Update procedure of an upper bound set based on redundancy elimina¬ 
tion_ 

input : U{N), z - Set of local upper bounds and new point 

output: U(AU{z}) 


1 

2 

3 

4 

5 

6 


A^{ue U{N) ■.zKu] 
B^{u^ U{N)\A: z<u} 
P ^ 0 

for u £ A do 

for j £ {1,... ,p} do 

P £- PU{{zj,U-j)} 

of A 


- Search zones that contain z 
~ Search zones whose boundary contains z 


- Generate all projections of z on the local upper bounds 


7 P £- {{zj, U-j) £ P : {zj,U-j) ^ u', Vtt' £ P U B} ~ Filter out all redundant points of 
P 

8 U{N U {z}) £- iU{N) \A)UP 


Basically, Algorithm updates each search zone C{u) in which the new point z lies by 
removing from C{u) the part of Z which is dominated by z (including z). This is achieved 
by replacing C(u) by p subzones as done in Step of Algorithm Some of these newly 
generated subzones may be redundant, and are thus removed in Step More formally, we 
state the following result, which justifies Algorithm 

Proposition 3.1. Let N G Z be a non-empty finite and stable set of points. Applying 
Algorithm iteratively on the points of N, starting with an initial upper bound set U (0) = 
{M}, returns the correct upper bound set U{N). 

Proof. We show that Algorithm correctly computes the set U{NU {2}), given any finite 
and stable set N G Z of points, the correct upper bound set U{N), and a new point z £ Z 
that is nondominated with respect to N. The result then follows by induction. 

Considering the new point z, the search region S{N U {z}) must be updated from S{N) 
by removing all points in Z such that z ^ z. 

In Step of Algorithm the search zones C{u), u £ A, containing ^ are identified. All 
other search zones C{u), u £ U{N) \ A, are not affected by the new point f and thus need 
not be modified. 
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Thus, we just need to remove the set of points {z € S{N) : z ^ z} from the search zones 
C{u), u ^ A, to ensure that condition (1) of Definition 2.3 is satisfied. Steps [4]j^ are justified 
by the fact that for any u € A we have 


p 

Ciu) \ {z G S{N) :zSz} = \J C{zj,u-j). 

i=i 


Among the candidate local upper bounds of P, as defined after all iterations of Step 
there may be some redundant local upper bounds in the sense that they induce search zones 
that are included in a search zone associated to some (candidate) local upper bounds of 
PU {U{N) \ A). Let {zj,U-j) G P, with u G A, he a redundant local upper bound, i.e. there 
exists u' G P U {U{N) \ A) such that z < {zj,u-j) < u' . If z < u' , then P contains the 
candidate local upper bound (zj,u'_j), otherwise we have u' G B. Therefore, Stepcorrectly 


filters the set P, which leads to satisfying condition (2) of Definition 2.3 


□ 


i.e. 


In Przybylski et al. (2010), the filtering step is formulated with respect to the set U{N), 
P e- {{zj,u-j) G P : {zj,u-j) ^ (u'), Vu' G U{N)}. 


This is correct, but involves unnecessary dominance tests compared to Algorithmic since one 
only needs to filter with respect to PU P instead of U{N). 

It is even possible to further refine the filtering step of Algorithm [C To this end, we prove 
the following proposition. 


Proposition 3.2. Let (zj,u-j) be a candidate local upper bound in P. Then: 

(1) {zj,U-j) < {zk,u'_j^) for some {zk,u'_j^) G P with k ^ j implies (zj,U-j) < {zj,u'_j); 

(2) {zj,U-j) < u' for some u' G B implies Zj = u'- and Z-j < u'_y 
Proof. 

(1) Since z < u', we have {zk,u'_jf) < u', which, together with (zj^U-j) < {zk,u'_f.), leads 
to {zj,U-j) < u', and thus {zj,U-j) < {zj,u'_j). 

(2) Since z < u and {zj,u-j) < u' we have z_j < u-j < u'_j. Moreover, with u' G B, we 
obtain Zj = u'-. 

□ 


According to property (1) of Proposition 3.2 the filtering step of Algorithm jC can be 
replaced by the following step: 

P ^ {{zj,u-j) G P : izj,u-j) ^ {zj,uLj), 

y{zj,u_j) G P and {zj,U-j) ^ u','iu' G B} 

which is equivalent to the following formulation: 

P {{zj,U-j) G P : {zj, U-j) ^ u', Mu' G (A U P) \ {«}} 

From property (2) of Proposition |3.2[ it is also possible to do fewer dominance tests against 
the local upper bounds of P. 
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Algorithm 3: Update procedure of an upper bound set based on redundancy elimina¬ 
tion with an enhanced filtering step 

input : U{N), z - Set of local upper bounds and new point 

output: U(AU{z}) 


1 

2 

3 

4 

5 

6 
7 


A •<— {« G [/ [N] z < u} - Search zones that contain z 

for j G {1,... ,p} do 

Bj •(— {u G U{N) : Zj = Uj and Z-j < U-j} 

for u G A do 

for j G {1,... ,p} do 

Pj ■<— Pj U {{zj,U-j)} - Generate all projections of z on the local upper bounds 
of A 


Pj ■<— {{zj,U-j) G Pj : {zj,U-j) ^ u', Mu' G Pj U Bj} 


8 for j G {1,... ,p} do 

9 

points of P 

10 U{N U {z}) ^ (UiN) \ A) U Pj 


- Filter out all redundant 


Overall, Proposition |3.2| shows that it is only required to perform dominance tests between 
vectors that differ in all but one component. We present these enhancements in Algorithm]^ 
where we split the sets B and P into p disjoint sets, respectively Bi,..., Bp and Pi,..., Pp, 
to stress the by-component filtering step. 

While Algorithm allows the correct computation of upper bound sets, it requires the 
iterative filtering for a possibly large number of candidate local upper bounds, which may 
be computationally expensive. In the next section, we establish structural properties of local 
upper bounds which yield necessary and sufficient conditions for a candidate local upper 
bound to become actually a (non-redundant) local upper bound. Then a new approach to 
the incremental computation of an upper bound set, which avoids the filtering step, is derived. 

4 Properties of local upper bounds and their efficient compu¬ 
tation 

In this section, we study some theoretical properties of local upper bounds that yield another 
approach which, in comparison to the algorithms presented in Section avoids the filtering 
step (namely Stepsandin Algorithm]^. 

The properties are first presented under a simplifying assumption that no two distinct 
points, among the points of Z to be considered, share the same value in any dimension. 
This assumption, denoted “SA” in the remainder, corresponds to what is referred to as a 
general position assumption in computational geometry. It is, however, not realistic for many 
instances of MOCO problems, that is why we extend the properties under the general case 
according to which identical component values among distinct points are allowed. 

We first illustrate the properties on small examples (Section |4.1[ ). Then we detail the 
properties and derive the new approach (Section |4.2[). 
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4.1 Introductory examples and geometric interpretation 

In this section, we give a geometric intuition to the properties that are detailed in the next 
sections through two example instances in the tri-objective case. First we present an example 
instance in the SA case (Example]^. Then we discuss the consequences of feasible points 
having identical component values (Example]^. 

Example 2 (Under SA). We consider a three-dimensional simple instance of our problem 
which consists of two feasible points: = (3,5,7) and = (6,2,4). Let us apply the 

incremental algorithm presented in Sectionj^first on U(0) = {AT} and z = z^ then on U{{z^}) 
and z = z"^. At the first iteration, z^ yields three local upper bounds, namely v} = (3, M, M), 

= (M, 5,M), and = (M, M, 7) so that U{{z^'\) = {v} Then at the second 
iteration we consider the three projections of 2^ on the local upper bounds whose associated 
search zones contain which are v? and v?. We get = (6,5,M), = (M, 2,M), 

and = (M, 5,4) for n^, and = (6,M, 7), = (M, 2,7), and = (M, M, 4) 

for u^. Projections and being redundant since and > u^‘^, we have 

U{{z^,z^}) = 

We represent the situation in Figure]^ The feasible points z^^z^ are depicted together 
with their Pareto dominance cones {z G Z : z^ ^ z}, i G {1,2}, in gray as well as the local 
upper bounds. The scene is represented in perspective from point m to point M so that the 
search zones go towards us. 



Figure 2: A three-dimensional example problem with points under SA 


Now we look at a particular local upper bound, say = (zf,n?_^). Consider any point 
z that belongs to the search zone defined by The jth projection of z on amounts to 
sliding along the half-line From Figure ^ we can see that if a projection 

of z on lies outside any of the three black line segments that start from then it will be 
redundant since it belongs to the closure of another search zone. We can see that these line 
segments are edges of the union of dominance cones associated to the points of N, plus three 
dummy points z^ = (M,m,m), z^ = (m,M,m) and z^ = (m,m, M). With these dummy 
points, even local upper bounds located on the boundary of Z lie at the intersection of three 
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dominance cones. We can now avoid the filtering step (Steps and of Algorithm if, for 
each local upper bound u, the p edges of the union which are incident to u are known. In the 
rest of this section, we consider facets of the union of the dominance cones associated to the 
points of N and to the dummy points 

We can see that the facets incident to are composed of two facets incident to that 
are shrunk after the first projection of and one facet which is a subset of a facet of the 
dominance cone associated to z^. So, in order to compute the edges incident to we only 
have to keep track of the three points that lower bound the facets, namely z^, z^, and z^. 
This holds because under SA, a facet is defined by a local upper bound and a single point of 
N. 



Figure 3: A three-dimensional instance with feasible points having the same value on com¬ 
ponent 2 


Example 3. Consider the three-dimensional instance represented in Figure with three 
feasible points z^ = (2, 7, 7), z^ = (5, 7,5) and z^ = ( 8 , 7, 3), which all share the same value on 
the second coordinate. We look again at facets of the union of all dominance cones associated 
to the points of N. The local upper bound u = (M, 7, M) is defined by z^ on component 1, 
z^ on component 3, and z^, z^, and z^ on component 2. We consider the facet of the union 
incident to u and orthogonal to the / 2 -axis. Similarly to the SA case, we may want to represent 
this facet by u and a single point defining a lower bound on the /i and /s values. Since this 
facet is incident to three feasible points we could define b = {z\,z\ = Z 2 ,Z 3 ) = (2,7,3) (see 
again Figure]^. 

However, this information may not be sufficient to avoid future redundancies. Consider 
for example the point z = (4, 3, 7) as depicted in Figure together with its Pareto dominance 
cone (in dotted lines). It satisfies z^ < zi < zf, Z 2 < ^2 = ^2 ^3 = ^ 3 - ^ defines among 

others the local upper bound u' = (z|,Z2,Z3) = (M, 7, 7). Unfortunately, one of the edges 
incident to u' represented as a dashed line in the figure is limited by an intermediate feasible 
point, namely z^. Therefore, it will be necessary in the general case to keep track of all 
feasible and dummy points that belong to a facet incident to a local upper bound. This is 
what the sets Z^(-) are aimed at in Section 


4.2 
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4.2 Theoretical properties of local upper bounds and a new incremental 
approach 

According to Step of Algorithm all components of a local upper bound u result from 
previously generated upper bounds for p — 1 components and, for the remaining component, 
from the currently added point z. The initial local upper bound M, however, is not defined 
from any point of Z. In order to make no particular case of the component values inherited 
from M, we extend any stable set of points from Z with the dummy points we introduced 
in the previous section. Namely, we define the extension of N as the set N = N U {z^, j = 
1 ,... ,p}, where 

j e {1,... ,p} 

It is not hard to see that U{{z^, j = l,...,p}) = {M}, i.e. the dummy points yield the 
initial search zone, which implies that for any finite and stable set N of points from Z, we 
have U{N) = U{N). 

Using dummy points, we now have that any component value of a local upper bound is 
defined by a point of N. 

Observe that a dummy point z^ can only define the jth component of any local upper 
bound, which is M. Indeed since no point from Z is lower than or equal to m on any 
component, m cannot be a component value of a local upper bound. Therefore, and since M 
is unique in the component values of a dummy point, z^ is the only dummy point that can 
define component j. 

The following proposition gives a useful property of those points that define each compo¬ 
nent of a local upper bound. 


Proposition 4.1. For any local upper bound u G U{N) and j G {1,... ,p}, there exists z G N 
such that Zj = Uj and Z-j < U-j. 


Proof. If Uj = M, then the dummy point z^ G N satisfies the required conditions. 

Otherwise and since iV is a finite set, there exists an e > 0 sufficiently small such that no 
point of N has its jth co mpo nent value in the interval {uj,Uj + e). Let u' = {uj + £,U-j). 


According to Proposition 2.6 since u' G Z and u' > u, there exists a z G N such that (i) 


z < u' and (ii) z jit u. It follows from (i) that we have z-j < u-j, which imposes Zj > uj from 
(ii). From the choice of e, we therefore have Zj = uj. □ 


In the following we define two notations for those points that define local upper bounds, 
for the general case and for the SA case, respectively. 

Definition 4.2. For any local upper bound u G U{N), we denote by Z^{u) = {z G N Zj = 
Uj and Z-j < U-j} the set of defining points of u for component j, j G {1,... ,p}. 

In the SA case, the unique defining point of u for component j is denoted z^{u). 


Using Proposition 4.1, we can now precisely characterize the projections which are kept 
in the set P after the filtering step of Algorithm We first consider the SA case. 


Theorem 4.3 (Simplifying assumption). Let z be a point of Z that is nondominated with 
respect to N and such that the points in A^U {z} satisfy SA. Consider a local upper bound 
u G U{N) such that z < u. Let = maxfc^jjzj (u)}. 

Then, for any j G{l,...,p}, {zj,U-j) is a local upper bound of U {N U {z}) if and only if 

Zj > z^^^{u). 
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Proof. Let u G U{N) and z G Z \ be a point not dominated by any point of N such that 
z < u. 


(=>) Suppose that u = {zj,U-j) is a local upper bound in U{NU {z}) and let z^^^{u) = 


Zj{u) for some point z^(u) G N, such that z^{u) = Uk, k j. Therefore, z^{u) = Uk 


and, from SA, no other point of N equals Uk on its kth. component. 
Proposition 4.1 we have z^^{u) < U-k, which implies z^{u) = z: 


^max 


Thus from 

(u) < Uj = Zj. 


(<^) Assume that for a given j G {1,... ,p}, Zj > z™^^(u). Suppose, to the contrary, that 
{zj,u-j) is not a local upper bound for U {z}, that is, it dominates a local upper 

there exists u' G U{N) such that 


3.2 


bound of U{N U {z}). Hence from Proposition 

{zj,U-j) < {zj,u'_j) (note that in the SA case, the set B defined in Algorithm [2| is 




empty). Then, we have U-j < u'_j, which implies Uj > and Uk < u'y. for some 
k j. Let z^{u ) G iV be the point that defines the fcth component of u. From 
we have z^^{u) < U-k- Thus, since k j, we have z^Au) < u' ■ 


4.1 


Proposition 

but since u' is a local upper bound, we must have z^{u) > u'- (otherwise z^{u) < u'). 

(u) and Zj < rt), we obtain 


Hence, z^ 


^max(^) > Zj{u) > u'j. Since we have both Zj > z 
a contradiction: Zj < u', < < Zj. 


max 

j 


□ 


Let us illustrate this theorem on the first example instance of Section |4.1 


Example 2 (continued). Consider the situation in Figure 2a with N = {z^}, where z^ = 
(3,5,7). The points that define the local upper bounds of U{N), namely = (3, M, M), 


,2 _ 


= (M, 5, M), and u'^ = (M, M, 7), are: 


z^{v}) = z^ 
z\v?) = z^ 
z^(u^) = z^ 


Z2(ul) =z2 

Z2(u2) =^1 

,3\ _ £2 


z\u-^) = z^ z\u-^) 


Z^(tt^) = z^ 
z‘^{v?) = zA 
z^iv?) = z^ 


and z™®'^(u^) = (m,5,7), z™^^(u^) = (3,m, 7), and z™'^^(tt^) = (3,5,m) 
The point z^ = (6, 2,4) strictly dominates vA and vA and we have: 

zf > zf^iA^) zl > z| < zf^^{A^) 

zl > zf^{A^) zl < zff^lu^) zl > 


thus we obtain again the four new local upper bounds = (zf,tt_i), = (zAufA, 
vA^ = {zl,vA_A^ and ^33 = {zl,ALA. 

According to Theorem |4.3[ we can avoid the filtering step of Algorithm if we keep track 
of the p points that define each local upper bound and only generate the projections of z that 
satisfy the conditions of Theorem 4.3 The corresponding algorithm is detailed in Algorithm]^ 

Note that each component of the vector z™'“(m) for a given local upper bound u will be 
used at most once in all iterations of Algorithmic That is why it is computed only before its 
use, namely at StepjC Moreover, this vector is not sufficient to compute the vector z^^^{uA 
associated to a local upper bound defined from u. Indeed, as the following example shows, 
it is required to keep track of all points that define the component values of uA as is done in 
Steps [SlflOl 
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Algorithm 4: Update procedure of an upper bound set based on the avoidance of 
redundancies: SA case _ 

input : U{N) together with z^{u), Vj G {1,... ,p},u G U{N) - Set of local upper 
bounds and associated defining points 

input : z - New point 

output: U(AU{z}) 


1 

2 

3 

4 

5 

6 

7 

8 
9 

10 


A ^ G U{N) :z<u} 

P ^ 0 

for u G A do 

for j G {1,... ,p} do 

maxk^j{z^} 


- Check for the condition of Theorem f.3 
if Zj > then 

- Let = {zj,U-j) 

P ^ P U {u^} 
z^{u^) ^ z 

for k G {1,... ,p}\{j} do 


z^iu) 


- Search zones that contain z 


11 U{N U {z}) ^ {U{N) \A)UP 


Example 2 (continued). Consider a new point z^ = (4,4,2) and the local upper bound 
= {6,5, M) with z™^^(ii^^) = (3,2,7), stemming from z^{u^^) = z^ = (6,2,4), z‘^{u'^^) = 
z^ = (3, 5, 7), and z‘^{u^^) = z^ = (m, m, M). 

We have and zf > z^^^{u'^^), thus = (-Z 2 )'^- 2 ) is a local upper bound of 

U{{z^, z"^, z^}). Since z^{u'^^'^) = z^{u'^^), z‘^{u'^^^) = z^, and z^{u‘^^‘^) = z^{u‘^^), we have 
_ 2 :max(^ 2 i 2 ) _ (4^2,4). As we can see, the last component value of which comes 

from z^{u^^‘^) = z^, cannot be obtained from z'^^^{u^^) or z^. 


In the general case, Theorem 4.3 is modified as follows 


Theorem 4.4. Let N be a finite and stable set of points of Z, and let z be a point of Z that 
is nondominated with respect to N. Consider a local upper bound u G U{N) such that z < u. 
Let zj^^^{u) = maxkjLj mhi{zj : z G Z^{u)}. 

Then, for any j G {1,..., p}, {zj,U-j) is a local upper bound of U{N U {z}) if and only if 
Zj > z”“(n). 

Proof. Let u G U{N) and z G Z \ A be a point not dominated by any point of N such that 
z < u. 


(=>) Suppose that u = {zj,U-j) is a local upper bound in U{N U {z}) and to the contrary 
Zj < z™^^(ii). Then, there is k j such that Zj < Zj for all z G Z^{u). Since u < u 
and Uk = Uk, it holds that Z^{u) C Z^{u) but for any z G Z^{u), Zj -ft Zj = Uj. Hence, 
Z^{u) = 0 which contradicts Proposition 

(-4=) Assume that for a given j G p}, Zj > zj^‘^^{u). Suppose, to the contrary, 

that {zj,u-j) is not a local upper bound for N LJ {z}, that is, it dominates a local 


4.1 
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3.2 


there exists n' G U{N), 


upper bound of U{N U {2:}). Hence from Proposition 
{zj,U-j) < (possibly with Zj = «'•). 

Then we have U-j < u'_j which implies Uj > u'j and Uk < u'^ for some k ^ j. 
From Proposition 4.1, the set Z^{u) is non-empty. For any z G Z^{u), we have 
Z-k < U-k and thus, since k ^ j, z-j < u'_j but since u' is a local upper bound, 
we must have Zj > u'- (otherwise z < «'). Hence, there is z G Z^{u) such that 
z™^^{u) > Zj > u'y Since we have both Zj > z™'^^(u) and Zj < u'-, we obtain a 
contradiction: Zj < u', < z™'^^(n) < Zj. 


□ 


We illustrate the general case on the second example instance of Section |4.1[ 

Example 3 (continued). In Figure^ we consider the situation with N = {z^,z^,z^} where 
z^ = (2,7,7), z^ = (5,7,5) and z^= (8,7,3). We only look at the local upper bound 
u = (M, 7, M). We have Z^{u) = {z^}, Z‘^{u) = {z^,z^,z^}, and Z^{u) = {z^}. Thus 
z“^^(u) = (2,m, 3). The projections of a point z that strictly dominates u will be kept as 
non-redundant local upper bounds depending on the comparisons between the component 
values of z and z™'^^(u) only. 

Algorithm presents the update procedure in the general case. The initialization is done 
with [/(0) = {M} and Z^{M) = {F}, j G {1,.. .,p}. 


5 Complexity and computational experiments 

In Sections and we described two incremental approaches for the update of an upper 
bound set. In Section]^ the approach is based on redundancy elimination (RE) among local 
upper bounds, while in Section it is based on redundancy avoidance (RA) with respect to 
local upper bounds. 

We first report upper bounds on the total number of local upper bounds associated to 
a discrete set of points N. Then we study the complexities of the RE and RA approaches. 
Finally, we present some computational experiments that compare these approaches. 


5.1 Tight upper bound on the number of local upper bounds 


None of the incremental algorithms proposed in the literature, even in the SA case, make it 
possible to directly derive a non-trivial upper bound on the size of any upper bound set U{N) 
for p > 4. 

For p = 2, the number of local upper bounds is clearly |A^| -|- 1 (see Example [^. For p = 3 
we recall that Dachert and Klamroth (2015) showed that it is upper bounded by 2|A^| -|-1 and 
is exactly 2|A^| -|- 1 in the SA case. 


For an arbitrary p > 2, 

Kaplan et al. 

2008 

) provide a tight upper bound on the size 

of U{N). Following 

Boissonnat et al. 

(1991 

i) who study the complexity of a union of axis- 


parallel hypercubes, they show that the number of maximal empty orthants with respect to a 
stable set N is OdA^l^sJ). They also provide an instance for which this number is H(|A^|I- 2 J). 
Therefore, and recalling that maximal empty orthants are in one-to-one correspondence with 
local upper bounds, 0 (|A"|I- 2 J) is a tight upper bound on the total number of local upper 
bounds associated to a stable set N. 
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Algorithm 5: Update procedure of an upper bound set based on the avoidance of 
redundancies: general case 

input : U(N) together with Z^{u) for all j G {1,... ,p}, u G U{N) - Set of local 

upper bounds and associated defining points 

input : z - New point 

output: U(AU{z}) 


A^{uG U{N) :z<u} 

P ^ 0 

- Update sets Z^{u) when z satisfies the conditions of Proposition f.l 
for u G U{N) and j G {1,... ,p} such that Zj = Uj and Z-j < U-j do 
L Z^{u) G- Z^u)U{z} 
for u G A do 

for j G {1 ,... ,p} do 

_j,max(^) ^ maxfc^j minizj : z G Z^{u)} 


- Search zones that contain z 


9 

10 

11 

12 


- Check for the condition of Theorem 4.4 
if Zj > z^^^iu) then 
- Let = {zj,U-j) 

P ^ PU {u^} 

Z^u^) G- {z} 
for k G {l,...,p}\{j} do 
L ^{zG Z^{u) : Zj < Zj} 


13 U(N U {z}) ^ (U(N) \A)UP 
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5.2 Worst-case complexities of the algorithms 

In this section, we analyze the worst case behavior of the two approaches. We consider the 
dimension p of the problem as a fixed parameter. The reference algorithm for the RE approach 
will be Algorithm while the reference algorithm for the RA approach will be Algorithm 
in the SA case, and Algorithm in the general case. 


Common steps of both approaches In the SA case, both approaches first compute the 
set A of local upper bounds whose associated search zones contain z. This amounts to |t/(A^)| 
dominance tests if U{N) is stored as a simple linked list. If A is small compared to U{N), it 
is possible to reduce the complexity of these operations. Actually, since the elements of A are 
those local upper bounds located in the hyperrecta ngle 0^=1 (%,A f), they can be obtained 
by an orthogonal range query on the set U{N) (see de Berg et ah, 2008, Chapter 5). In the 
case p = 2, U{N) can be efficiently stored in a simple balanced binary search tree. For p > 3, 
as in the case of the algorithm of Kaplan et al. (2008), U{N) can be stored in a dynamic 
p-dimensional range tree (see e.g. Willard and Lueker, 1985), which allows insertions and 
deletions in 0(log^ |C/(A^)|) time and orthogonal range queries in 0(log^ |[/(A')| + |A|) time. 
We note that augmented dynamic range trees ( [Mehlhorn and Naher[ 1990[ Theorem 8) lower 
the “log” factors to log^“^ |[/(A^)|loglog |[/(iV)|. 


Remaining steps We assume that p > 3 since it can be easily seen that both approaches 
operate identically in the case p = 2. Both approaches consider p\A\ candidate local upper 
bounds. 

We hrst consider the SA case. We focus on the operations on which Algorithm (RE 
approach) and Algorithm]^ (RA approach) differ. They correspond to Stepsjsjj^ (Algorithm]^ 
and Steps [3p0| (Algorithm]^, and respectively involve sets Pj, j G {1,... ,p}, and P. 

Proposition 5.1. The worst-case complexity of Steps in Algorithm is bounded by 

0(|A|2). 


Proof. The complexity of these steps is dominated by the hltering (Stepsandof each Pj, 
j G {1,... ,p}, where \Pj\ = |A|, therefore the total time is 0(|Ap). □ 


This can be reduced to 0(|A|log|A|) in t he case p G |2,3| ( Kung et al. 
0(|A| log^“^ |A| loglog |A|) in the case p > 4 (Gabow et al 
algorithms. 


1975) and 


1984) using some specialized 


Proposition 5.2. The worst-case complexity of Steps 
0{\A\). 

Proof In Algorithmic no additional dominance test is performed with the local upper bounds 
of P, but the values z™®'^(n) need to be computed just before they are needed, each of which 
takes constant time. Also the references to the p points that define each local upper bound 
have to be updated which takes constant time for each new upper bound. The total time of 
these operations is thus 0(|A|). □ 


10 in Algorithm^ is bounded by 


In the general case, the number of local upper bounds against which candidate local upper 
bounds have to be checked for dominance in the RE approach just grows by an additional 
|i3|. In the RA approach adapted to the general case, namely Algorithm jC it is possible that 
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This leads to an upper bound on 


|A^| points have to be considered in a set Z^{u) at Step 
the complexity of 0(|A^||^|) in Algorithm]^ 

In practice, however, the size of the sets Z^[u) is rather small depending on how many 
points in N share the same component values. Note that according to Boissonnat et al. 


(1998), an alternative approach would be to slightly shift those points in N that do not 
satisfy SA such that the resulting set satisfies SA. Then Algorithm can be applied, yielding 
a complexity of 0(|A|). Similarly, ties in the comparisons of any jth component values for 


where <ie 


if 


points and z^ could be resolved by a lexicographic comparison “<ie 

z^ < Zj or if Zj = Zj and k < I, which would replace the natural comparison “<” between reals 
(and similarly for “>”) in Algorithm]^ However these approaches yield redundant search 
zones that, in the context of Algorithm induce redundant solver calls. 


5.3 Experimental comparison of the algorithms 

In this section we investigate the behavior of the RE and RA approaches on random instances. 


Experimental setup We implemented Algorithmfor the RE approach and Algorithmic 
for the RA approach. Both algorithms were implemented in C. The experiments were run on 
a workstation equipped with an Intel Core i7-3840QM CPU at 2.80GHz with SMB cache and 
32GB RAM. For both algorithms, we considered the version that does not require SA, since 
the assumption cannot be made in most applications. 

As test instances, we generated random stable sets of points N. In order to obtain a new 
point in the random stable set being generated, we uniformly draw from the integer set [1, K]p 
and reject the points that are dominated by or dominate any of the previous points. We draw 
without or with replacement in [1, Ai], respectively, to obtain points satisfying SA or not. In 
the general case, the parameter K controls to what extent objective values are shared among 
feasible points. In the SA case, K is just set to a very large integer. Since in both cases the 
distribution of each point is conditioned by the requirement that it is neither dominated by 
nor dominates any previously generated point, the generated points are eventually randomly 
reordered. 

We considered instances for p £ {3,4, 5,6} having 100 000, 50 000, 25 000, and 5 000 points, 
respectively. We generated instances under SA and also with possible identical component 
values. In the general case, we set K so as to obtain ^ G {5,10}. The plots we made in the 
SA case were obtained by recording intermediate results every 500 points for p G {3,4, 5} and 
every 100 points for p = 6. We also considered a pathological instance type in the general 
case having many duplicated component values among points, with p = 6, |A^| = 10 000 and 
K = 10. 

We have drawn 10 instances of each type and the output results were averaged over the 
10 runs carried out for each instance type. 


Observations on the SA instances We provided above a theoretical tight upper bound 
on the number of local upper bounds in SA instances. Now we consider the empirical number 
of local upper bounds observed in our test instances for p G {4,5,6} (since this number is 
known exactly for p = 3). The results, which can be obtained by any of the two approaches, 
are reported on Figure According to Figure it seems that on such random instances, 
the number of local upper bounds grows approximately linearly in the number of points. 


Kaplan et al. (2008) show that the number of maximal empty axis-parallel boxes in a set of n 
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points drawn uniformly and independently from [0,1]^ is 0(n log^~^ n), therefore the growth 
observed in our experiments may be superlinear. However, the distribution of our points is 
not the same since we discard points that dominate or are dominated by previously drawn 
points and the bound of Kaplan et ah (2008) does not count only maximal empty orthants. 

Observing from Figure]^ the apparently linear relation between \N\ and |C/(A^)|, we per¬ 
formed a simple linear regression. We obtained the following slopes for the fitted lines: 6.524 
for p = 4, 31.86 for p = 5, and 165.9 for p = 6. This gives an insight on the increase in 
the number of local upper bounds induced by the consideration of a new point in the search 
region, i.e. the average |[/(A^ U {z})| — |C/(A^)|. 



100 200 500 1000 2000 5000 10000 20000 50000 


Number of points 


Figure 4: Number of local upper bounds on SA instances (logarithmic scales for both axes) 

We also computed the average number of search zones that contain the current point 
(namely |A|) between two observations. Since these values do not vary much on the tested 
instance, we provide the averages over all instances of all sizes: 3.999 for p = 3, 21.56 for 
p = 4, 141.67 for p = 5, and 735.9 for p = 6. 

From the average \U{NU {z})| — |t/(A^)| and |A|, we compute the ratio _ 

We obtain 0.5001 for p = 3, 0.3025 for p = 4, 0.2249 for p = 5, and 0.2255 for p = 6. 
This indicates that the number of additional search zones induced by each search zone that 
contains the current feasible point remains small. 

Comparison of the algorithms We first provide raw computation times in Tableshow¬ 
ing the performance of the RE and RA approaches on SA and on general instances. 

Since the computation times of the algorithms we consider to generate U{N U {2}) are 
both n(|f7(A")|), we also present normalized computation times. Figure shows running 
times divided by | U{N) \. 

According to these results, the RE approach remains the best one in terms of computation 
time for p G {3,4,5}, the values being rather close in the case p = 5. The RA approach 
however outperforms the RE approach for p = 6. These observations hold for SA and general 
case instances but the gaps between the relative efficiency of the approaches are larger on SA 


22 
























RE approach RA approach 


p 

3 

4 

5 

6 

3 

4 

5 

6 

5 000 

0.232 

1.09 

26.3 

614.0 

0.289 

2.18 

35.2 

179.0 

25 000 

6.93 

93.4 

830.0 

- 

16.6 

154.0 

951.0 

- 

50 000 

44.6 

509.0 

- 

- 

122.0 

673.0 

- 

- 

100 000 

387.0 

- 

- 

- 

664.0 

- 

- 

- 


(a) Simplifying assumption 


RE approach RA approach 


p 

\N\\ 

3 

4 

5 

6 

3 

4 

5 

6 

5 000 

0.192 

0.882 

13.4 

530.0 

0.24 

1.15 

18.7 

166.0 

25 000 

6.18 

68.3 

767.0 

- 

9.53 

112.0 

862.0 

- 

50 000 

36.0 

463.0 

- 

- 

77.0 

582.0 

- 

- 

100 000 

339.0 

- 

- 

- 

498.0 

- 

- 

- 


(b) No simplifying assumption, ^ = 5 


RE approach RA approach 


p 

\N\^ 

3 

4 

5 

6 

3 

4 

5 

6 

5 000 

0.167 

0.772 

12.1 

447.0 

0.218 

0.978 

16.7 

150.0 

25 000 

5.99 

65.6 

754.0 

- 

7.84 

107.0 

839.0 

- 

50 000 

32.8 

447.0 

- 

- 

69.2 

564.0 

- 

- 

100 000 

325.0 

- 

- 

- 

459.0 

- 

- 

- 


(c) No simplifying assumption, ^ = 10 


Table 1; Average computation times (in seconds) for both approaches 
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Figure 5: Comparison of the normalized running times of the two algorithms in the SA case 
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instances. Besides, additional computational experiments on SA instances with p G {7,8} 
showed that the RA approach performs even better above p = 6. Namely, we obtained the 
following average computation times (RE time in seconds, RA time in seconds): (161.69, 
5.046) for p = 7, n = 500, (1 240.11, 27.458) for p = 7, n = 1 000, (24.06, 0.348) for p = 8, 
n = 125, (423.15, 2.330) for p = 8, n = 250. 

We also observed in our experiments that, even starting from p > 3, a little fewer com¬ 
ponent comparisons are made in the RA approach than in the RE approach. Finally, we ran 
the implementations under Cachegrind, a CPU caches profiling tool. We observed for the 
RA approach a larger use of the slowest caches, L2 and L3, than for the RE approach. This, 
together with the smaller average |A| observed on low dimensional instances, explains why 
the implementation of the RA approach performs worse than the one of the RE approach for 
p < 5. 

To observe the effect of highly duplicated component values among distinct points, we also 
tested the approaches on the pathological instances {p = 6, |A^| = 10 000, and K = 10). The 
average |f7(iV)| and |A| are much smaller than in the SA case, being respectively 14 228.4 and 
33.44. Due to the fact that many points share the same component values, the sets Z^{u) in 
Algorithm]^ can grow significantly, reaching the maximum value of 1 109.7, averaged on the 
test instances. Therefore, the computation time of the RA approach is a little longer than 
the one of the RE approach (1.95 against 1.51 seconds). 


6 Conclusions 


We addressed in this paper the problem of representing the search region in MOO. The concept 
itself is used in numerous approaches to compute the nondominated set. We provided several 
equivalent definitions of the search region. Local upper bounds induce a decomposition of the 
search region into search zones. We reviewed possible uses of this decomposition to enumerate 
all nondominated points of an MOCO problem. We presented two incremental approaches 
to compute the local upper bounds that represent a search region, respectively based on 
“redundancy elimination (RE)” and “redundancy avoidance (RA)”. The first encompasses an 
already known algorithm for which we proposed some enhancements to its filtering step. The 
second is derived from theoretical properties of local upper bounds we studied and avoids the 
filtering step of the former. Finally, we considered the complexity of the representation of the 
search region by local upper bounds and gave some insights into the theoretical complexities 
and the practical efficiencies of the two incremental approaches. In particular, we showed that 
the RA approach developed in this paper performs better than the RE approach starting from 
dimension 6 on instances where the objective ranges are not too small. 

The future work directions are numerous. Although the RA approach is practically less 
efficient than the RE approach in low dimensions, it maintains, contrary to the latter, a 
relation between feasible points and local upper bounds. This makes it possible to define a 


neighborhood between local upper bounds, as in Dachert and Klamroth (2015) in the case 


p = 3, that can be exploited in order to update the search region more efficiently when a 
search zone containing the new feasible point is known. Derivatives of the concept of search 
region defined in this paper could also be considered. Actually, we made no assumption 
on the feasible points that define the search region, apart from the requirement that they 
constitute a stable set of points. If e.g. the feasible points are optimal with respect to one 
objective function, some search zones may be discarded. Note also that the search zones that 
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are defined in this paper are bounded below by the same point m. It may be interesting 
to bound below each search zone using some local lower bounds such that the union of the 
corresponding restricted search zones still contains all unknown nondominated points. 
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